Papers with Visual Retriever-Reader pipeline
Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing knowledge-based visual question answering systems rely on Concept-Net and Wikipedia to obtain external knowledge. |
| Approach: | They propose a visual retriever-reader pipeline that uses a natural language knowledge base and a Visual retriever to retrieve relevant knowledge. |
| Outcome: | The proposed method significantly improves the visual retriever-reader pipeline on the OK-VQA benchmark. |